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BACKGROUND OF THE INVENTION 



1. FIELD OF THE INVENTION: 

The present invention relates to a pixel defect 
5 detector which is provided in a solid-state imaging device 
such as a CCD for automatically detecting a defect produced 
in the solid-state imaging device. 

2. DESCRIPTION OF THE RELATED ART: 

10 It is generally known in the art that the quality 

of a solid-state imaging device such as a CCD may 
deteriorate due to a local crystal defect (also referred 
to as a "blemish") which is produced therein while being 
manufactured. Moreover, an additional blemish may be 

15 produced in the solid-state imaging device after shipping 
by the irradiation of cosmic rays . Such blemishes can be 
classified into white blemishes and black blemishes. 

Figure 6 shows a graph illustrating output 
20 characteristics in response to the amount of incident 
light of different photoelectric transducers (referred 
to also as "pixels") provided in a solid-state imaging 
device. In Figure 6, the solid line A represents an 
output characteristic of a normal pixel, the broken line B 
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represents that of a pixel having a white blemish, and 
the one-dot chain line C represents that of a pixel having 
a black blemish. As can be seen from the output 
characteristic represented by the broken line B, a white 
5 blemish is a defect due to which a bias voltage is always 
added to an output of the pixel. Moreover, as can be seen 
from the output characteristic represented by the one-dot 
chain line C, a black blemish is a defect by which the 
sensitivity of the pixel is reduced. 

10 

Conventionally, various devices and methods have 
been proposed in the art for detecting such a blemish in 
a pixel and correcting the output of such a pixel. 



15 For example, Japanese Laid-Open Publication 

No. 8-195909 discloses an arrangement comprising: a ROM 
for storing data representing the position and the level 
of a CCD blemish which is already present prior to 
shipping; and an EEPROM for storing data representing the 

20 position and the level of a CCD blemish which is 
additionally produced after the shipping. According to 
this arrangement, the output of the CCD having a blemish 
is corrected based on the data stored in the ROM and the 
data stored in the EEPROM. 
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Japanese Laid-Open Publication No. 7-7675 dis- 
closes a technique in which a blemish of a CCD is detected 
after performing an inverse y correction on an output 
5 signal of the CCD. The inverse y correction is performed 
because once a y correction is performed, the amount of 
error occurring in the output signal of the CCD due to 
the blemish is reduced, whereby the blemish detection is 
difficult . 

10 

Japanese Laid-Open Publication No. 62-8666 dis- 
closes a technique of substituting the output signal of 
a pixel having a blemish with the output signal of another 
pixel in the same row or column. 

15 

In the prior art, however, the detection of a 
blemish in a solid-state imaging device either before or 
after shipping requires a reference light generator for 
producing various (dark to bright) levels of reference 
20 light incident upon the device, an aided system, and the 
like. Moreover, in the prior art, the detection of a 
blemish in a pixel and the correction of the output from 
the pixel may be difficult for anyone but an expert 
operator. These operations are far from those which can 
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ordinarily be done by a user, 



SUMMARY OF THE INVENTION 

5 According to one aspect of this invention, a pixel 

defect detector for a solid-state imaging device 
comprising a plurality of photoelectric transducers is 
provided. The pixel defect detector includes: a 
calculation section for obtaining output characteristics 
10 of a subject photoelectric transducer for varied amounts 
of light incident thereupon so as to determine the 
presence/absence of a defect in the subject photoelectric 
transducer based on the output characteristics thereof. 



15 In one embodiment of the invention, the pixel 

defect detector further includes a picture memory for 
storing an output signal from the photoelectric transducer. 
The calculation section determines the output 
characteristics of the subject photoelectric transducer 

20 using the output signal of the subject photoelectric 
transducer stored in the picture memory. 



In one embodiment of the invention, the output 
characteristics of the subject photoelectric transducer 
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are represented by a plurality of output signals of the 
subject photoelectric transducer in response to different 
amounts of light incident thereupon, respectively. 

5 According to another aspect of this invention, a 

pixel defect detector for a solid-state imaging device 
comprising a plurality of photoelectric transducers is 
provided. The pixel defect detector includes: a picture 
memory for storing outputs from a subject photoelectric 

10 transducer in response to different amounts of light 
incident thereupon, respectively; and a calculation 
section for determining a photoelectric coefficient a of 
the subject photoelectric transducer and an offset output 
level b of the subject photoelectric transducer in the 

15 absence of incident light based on the amounts of incident 
light, the outputs from the subject photoelectric 
transducer therefor, and Expression (1) below, so as to 
compare the photoelectric coefficient a and the offset 
output level b with a predetermined reference 

20 photoelectric coefficient a 0 and a predetermined refer- 
ence offset output level b 0/ respectively, thereby 
determining the presence/absence of a defect in the 
subject photoelectric transducer: 

y (x) =ax+b ... ( 1 ) 
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where y(x) denotes the output of the subject 
photoelectric transducer, and x denotes the amount of 
incident light, 

5 In one embodiment of the invention, the pixel 

defect detector further includes an optical system for 
projecting a picture onto the solid-state imaging device. 
The output of the photoelectric transducer is determined 
while the optical system is def ocused with respect to the 
10 solid-state imaging device. 

In one embodiment of the invention, the amounts 
of light incident upon the subject photoelectric 
transducer comprise an amount of incident light when no 
15 light is incident upon the solid-state imaging device and 
another amount of incident light which brings the 
solid-state imaging device to a near-overflow state. 

In one embodiment of the invention, the amount of 
20 incident light x is determined by applying, to Expres- 
sion (2) below, the predetermined reference photoelec- 
tric coefficient a 0 , the predetermined reference offset 
output level b 0 , and a reference output signal y 0 : 

x=(y 0 -b 0 )/a 0 ... (2) . 
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In one embodiment of the invention, the output y 0 
is set to a median among outputs from a plurality of 
photoelectric transducers neighboring the subject pho- 
5 toelectric transducer. 

In one embodiment of the invention, the 
neighboring photoelectric transducers comprise only 
those which display the same one of a plurality of colors 
10 to be displayed as that of the subject photoelectric 
transducer. 

In one embodiment of the invention, the pres- 
ence/absence of a defect in the subject photoelectric 
15 transducer is determined by applying the photoelectric 
coefficient a of the subject photoelectric transducer, 
the offset output level b of the subject photoelectric 
transducer, the reference photoelectric coefficient a 0 , 
and the reference offset output level b 0 , to Expres- 
20 sion (3) below: 

no defect, if |a 0 -a|<Aa and |b 0 -b|<Ab ... (3) 
where Aa and Ab are predetermined threshold 

values. 
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In one embodiment of the invention, the pres- 
ence/absence and the type of defect in the subject 
photoelectric transducer are determined by applying the 
photoelectric coefficient a of the subject photoelectric 
5 transducer, the offset output level b of the subject 
photoelectric transducer, the reference photoelectric 
coefficient a 0 , and the reference offset output level b 0 , 
to Expression (4) below: 

no defect, if |a 0 -a|<Aa and |b 0 -b|<Ab; 
10 a black blemish, if |a 0 -a|^Aa; and 

a white blemish, if |b 0 -b|;>Ab ... 

(4) 

where Aa and Ab are predetermined threshold 

values . 

15 

In one embodiment of the invention, the reference 
photoelectric coefficient a 0 and the reference offset 
output level b 0 are prescribed for each of the colors to 
be displayed. 

20 

In one embodiment of the invention, the pixel 
defect detector further includes a determination section 
for determining a color to be displayed by the subject 
photoelectric transducer based on address data of the 
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subject photoelectric transducer. The reference 

photoelectric coefficient a 0 and the reference offset 
output level b 0 are prescribed based on the determination 
by the determination section . 

5 

Thus, the invention described herein makes 
possible the advantages of providing a pixel defect 
detector for a solid-state imaging device, which does not 
require a reference light generator, a special aided 
10 system, or the like, and with which the detection can be 
easily done by a user. 

These and other advantages of the present 
invention will become apparent to those skilled in the 
15 art upon reading and understanding the following detailed 
description with reference to the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 Figure 1 is a graph illustrating input/output 

characteristics of a photoelectric transducer; 



Figure 2 is a plan view illustrating an 
arrangement of the primary colors in a color filter 
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according to a primary colors Bayer pattern; 

Figure 3 is a block diagram illustrating a digital 
still camera incorporating a pixel defect detector 
5 according to one embodiment of the present invention; 

Figure 4 is a flow chart illustrating a procedure 
performed by the apparatus shown in Figure 3; 

10 Figure 5 is a block diagram illustrating a 

switching module provided in the apparatus shown in 
Figure 3 ; and 

Figure 6 is a graph illustrating input/output 
15 characteristics of a photoelectric transducer. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

First, the general description of the present 
20 invention will be below. 

As described above, the prior art procedure of 
applying reference light from a reference light generator 
across a solid-state imaging device, detecting a pixel 
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having a blemish based on an output signal of the 
solid-state imaging device using a special aided system, 
and then correcting the output of such a pixel, is far 
from that which can ordinarily be done by a user. 

5 

It is assumed in the present invention that no 
reference light generator for applying reference light 
is used. In such a case, the amount of light incident upon 
the solid-state imaging device cannot be determined, and 

10 a pixel having a blemish cannot be identified simply by 
comparing an output signal of a pixel with that of another 
neighboring pixel. For example, referring to the graph 
of Figure 1, when comparing an output characteris- 
tic fl(x) of a normal (i.e., not blemished) pixel in 

15 response to an amount of incident light with an output 
characteristic f2(x) of a pixel having a black blemish 
in response to an amount of incident light, the difference 
(e.g., Ayl or Ay2 ) between the output characteris- 
tic fl(x) and the output characteristic f2(x) varies 

20 depending upon the amount of incident light. Therefore, 
a pixel having a blemish cannot be identified based on 
such a difference unless the amount of incident light can 
be accurately determined. When one attempts to determine 
the presence /absence of a blemish based on only one 
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difference between the output characteristic fl(x) and 
the output characteristic f 2(x) , the presence/absence of 
a blemish cannot be determined in a precise manner, as 
a white blemish and a black blemish cannot be accurately 
5 distinguished from each other. 

Thus, according to the present invention, a pixel 
having a blemish is identified by using a function of 
Expression (1) below which represents the output 
10 characteristic of a pixel of the solid-state imaging 
device . 

y (x) =ax+b ... ( 1 ) 

15 Herein, y(x) denotes an output level of a pixel 

(or a photoelectric transducer) being examined 
(hereinafter, a "subject pixel"), x denotes an amount of 
incident light, a denotes a photoelectric coefficient of 
the pixel, and b denotes an offset output level of the 

20 pixel in the absence of incident light. 

When comparing the function of one normal pixel 
with that of another normal pixel, the values of the 
coefficients a and b for one pixel are close to those for 
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the other pixel, respectively. Moreover, the values of 
the coefficients a and b for each normal pixel are 
substantially equal to an average reference photoelectric 
coefficient a 0 and an average reference offset output 
5 level b 0 . For a pixel having a black blemish, the 
photoelectric coefficient a is smaller than the reference 
photoelectric coefficient a 0 . For a pixel having a white 
blemish, the offset output level b is larger than the 
reference offset output level b 0 • 

10 

The photoelectric coefficient a and the offset 
output level b of one pixel are constant regardless of 
the amount of light incident thereupon. Therefore, the 
presence/absence and the type of defect of the pixel can 
15 be determined by obtaining the above-described function 
for the pixel. 

When N different amounts of incident light (from 
dark to bright) , x 0 , Xi, . . . , x N -!, are applied to a subject 
20 pixel, thereby obtaining N output levels, y 0 , yi, . . - , Yu-x* 
corresponding to the subject pixel, the input /output 
relationship of the subject pixel can be represented by 
Expression (5), which is below based on Expression (1) 
above . 
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"y 0 




*x 0 1 " 


yi 

• 




X1 1 

• 


yR-i. 




• 



(5) 



By using a least squares method, the photoelectric 
coefficient a and the offset output level b of a subject 

10 pixel can be obtained by applying the amount of light x ± 
incident upon the subject pixel and the actual output 
level y± for the amount of light x to Expression (7) below, 
on the condition that the sum o of squares of errors 
obtained by Expression (6) below is minimized (for the 

15 least squares method, see, for example, "Sensor and Signal 
Processing System II", pp. 10-11, 1985, Japan Society of 
Mechanical Engineers eds , published by Asakura Shoten). 



20 



ff =S(y(xO-yj) 2 

1=0 



(6) 



I> 2 2>i 




"a" 




2>yi 


2>i N 








2> . 



(7) 
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Since no reference light generator is used in the 
present invention, the amount of light x A incident upon 
a subject pixel is not the amount of reference light, and 
thus is not readily specified. Therefore, the amount of 
5 incident light x ± is estimated before obtaining the 
photoelectric coefficient a and the offset output level b 
from Expression (7) above. 



In order to estimate the amount of light x ± 
10 incident upon the subject pixel, the outputs of the subject 
pixel and the neighboring pixels within a prescribed pixel 
region are examined as follows. The term "pixel region" 
as used in this specification refers to a prescribed region 
on an imaging screen within which is included a number 
15 of pixels, including the subject pixel. The output levels 
of some or all of the number of pixels are examined to 
estimate the amount of light incident upon the subject 
pixel. For example, the outputs of the subject pixel and 
other neighboring pixels, which are located along the 
20 upper, lower, left and right sides of the subject pixel, 
are examined. If the number of pixels having the same type 
of defect is less than or equal to half of the number of 
the selected pixels, it is possible to obtain an output 
level of a normal pixel by obtaining the median y 0 of the 
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output levels of the selected pixels through a median 
filter represented by Expression (8) below. 

7=medianlyt,y2,y3,y4,y 5 } 
5 = yi;wheny 2 <y3<yi<y 4 <y5 ... m 

Herein, y± (i=l, . 5) denotes the output level 
of the five pixels selected from the same pixel region. 

10 

For example, where yi denotes the output level of 
a normal pixel, y 2 and y 3 denote the output levels of pixels 
having a black blemish (smaller than the output level of 
the normal pixel), and y 4 and y 5 denote the output levels 

15 of pixels having a white blemish (larger than the output 
level of the normal pixel), then, the median y 0 obtained 
through the median filter is equal to the output level yi 
of the normal pixel. Alternatively, when only normal 
pixels are selected from a pixel region, the median among 

20 the output levels of the normal pixels is obtained. 

Once an output level y 0 of a normal pixel is 
obtained, it is possible to obtain the amount of light x 
incident upon the subject pixel by applying the output 
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level y 0 to Expression (2) below. 

x=(Yo-bo)/a 0 ... (2) 

5 Herein, a 0 denotes an average reference 

photoelectric coefficient among the normal pixels, and 
b 0 denotes an average reference offset output level among 
the normal pixels . 

10 The output level y 0 of a normal pixel in the pixel 

region is obtained for each of N different amounts of light 
(from dark to bright), x 0 , x x , x N _i, being applied. 

The output level y 0 is applied to Expression (2) above, 
so as to calculate each of the amounts of incident light, 

15 Xo / Xi , . . . , Xn-i . 

Once the amounts of light, x 0 , x i# x N _i, 
incident upon the subject pixel are determined as de- 
scribed above, it is possible to determine the 
20 photoelectric coefficient a and the offset output level b 
of the subject pixel by applying, to Expression (7) above, 
the determined amounts of incident light and the actual 
output levels y 0 , yi, . . . , yn-i, from the subject pixel in 
response to the amounts of incident light. 
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For displaying multiple colors, the reference 
photoelectric coefficient a 0 varies for the respective 
colors to be displayed. For example, in order to produce 
5 a color display with the three primary colors R # G and 
B, it may -be necessary to prescribe a reference 
photoelectric coefficient a 0 for each of the primary 
colors R, G and B. In such a case, a subject pixel in a 
pixel region and pixels which are in the same pixel region 

10 and which represent the same color as that of the subject 
pixel are selected, and the median output level among the 
selected pixels is obtained by Expression (8) above. 
Then, the amount of incident light x is calculated based 
on Expression (2) above, and the photoelectric coeffi- 

15 cient a is calculated based on Expression (7) above. 

Instead of a 0 in Expression (2) above, values a 0 R, 
a 0G and a 0 B are used which denote predetermined reference 
photoelectric coefficients for the primary colors R, G 
20 and B, respectively. Moreover, the photoelectric 
coefficients obtained for the primary colors R, G and B 
are denoted by a R , a G and a B , respectively. 



It is not necessary to obtain the offset output 
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level b and the reference offset output level b 0 for each 
of the primary colors, but these values can be commonly 
used among the primary colors. 

5 Where no special device, such as a reference light 

generator, is used as in the present invention, it is very 
difficult to make a uniform amount of light be incident 
across the solid-state imaging device. Therefore, in the 
present invention, it may be necessary to minimize the 
10 size of a pixel region including the subject pixel so that 
a uniform amount of light is incident across the pixel 
region . 

Figure 2 illustrates a color filter of a primary 
15 colors Bayer pattern. When such a color filter is em- 
ployed for producing a color display, a pixel region maskl 
is prescribed surrounding a subject pixel Rl for the 
primary color R, and nine pixels R x , R 0 are selected from 
the pixel region maskl to obtain the amount of light 
20 incident upon the subject pixel. Similarly, for the 
primary color B, a pixel region mask2 is prescribed 
surrounding a subject pixel Bl and nine pixels B 1# B 0 are 
selected from the pixel region mask2 to obtain the amount 
of light incident upon the subject pixel. For the primary 
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color G, a pixel region mask3 or mask4 is prescribed 
surrounding a subject pixel Gl and nine or five pixels G 1# 
G 0 are selected from the pixel region mask3 or mask4 to 
obtain the amount of light incident upon the subject pixel. 

5 

The relatively small pixel region mask4 is used 
to obtain an accurate amount of light incident upon the 
subject pixel Gl because the human eye is most sensitive 
to the primary color G of the three primary colors . 

10 

In this way, the amount of incident light and the 
output level are obtained for each subject pixel, so as 
to obtain one of the photoelectric coefficients a R , a G and 
a B corresponding to the color displayed by the subject 
15 pixel, and the reference offset output level b 0 which is 
common to the primary colors R , G and B . Then , the 
presence/absence and the type of defect are determined 
based on Expressions (9), (10) and (11) below. 



20 Where the subject pixel displays the primary 

color R, the subject pixel has: 

no defect if |a 0 R-a R |<Aa R and |b 0 -b|<Ab R ; 
a black blemish if | a 0R -a R | ssAa R ; and 
a white blemish if |b 0 -b|^Ab R . 
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(9) 



Where the subject pixel displays the primary 
color B, the subject pixel has: 
5 no defect if |ao B -a B |<AaB and |b 0 -b|<Ab B ; 

a black: blemish if | a 0B -a B 1 2*Aa B ; and 
a white blemish if |b 0 -b|;>Ab B . 

... (10) 

hi 

% yr 10 Where the subject pixel displays the primary 

11 color G, the subject pixel has: 

gjf no defect if |a 0G -a G |<Aa G and |b 0 -b|<Ab G : 

;^ a black blemish if | a 0G -a G | ;>Aa G ; and 

;5f a white blemish if |b 0 -b|;>Ab G . 

m 15 ... (11) 

Herein, Aa R , Aa B , Aa G , and Ab R# Ab B , Ab G are 
threshold values, which are prescribed separately for the 
respective primary colors R, G and B so as to improve the 
20 detection/determination precision . 



In order to obtain the photoelectric coeffi- 
cient a and the offset output level b based on Expres- 
sion (7) above, the left side of Expression (7) needs to 
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be non-zero, i.e.. Expression (12) below needs to hold. 
In other words , the series of N functions in Expression ( 5 ) 
above need to be independent from one another. Under a 
condition close to the ideal condition (e.g., where 
5 substantially no white noise exists), the series of N 
functions are correlated to one another, whereby 
Expression (12) below does not hold. Then, the photoe- 
lectric coefficient a=a 0 , and the offset output 
level b=b 0 - 

0 

5>i N 



(12) 



15 In the manner as described above, the pres- 

ence/absence and the type of defect are determined for 
each subject pixel . Then , if a subject pixel has a defect , 
the output level of the pixel will be corrected. 

20 The bias voltage added to the output of a pixel 

having a white blemish varies depending upon the 
temperature, while the sensitivity of a pixel having a 
black blemish is deteriorated. Therefore, simple addi- 
tion or subtraction of a constant voltage to/from the 
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output of such a pixel may not sufficiently correct the 
output of the pixel. It is preferred to correct the output 
signal of a pixel having a defect using the output signal 
of each of one or more neighboring pixels. 

5 

For correcting the output signal of the pixel 
having a defect, using the output signal of each of one 
or more pixels which are horizontally neighboring the 
subject pixel along with those of one or more pixels which 

10 are vertically neighboring the subject pixel is more 
preferred for the following reason than using only the 
output signal of one or more pixels which are neighboring 
the subject pixel either in the horizontal or vertical 
direction. For example, when the subject pixel having a 

15 defect is located along an edge of the object being imaged, 
the output of a pixel horizontally neighboring the subject 
pixel is likely to be substantially different from that 
of a pixel vertically neighboring the subject pixel. In 
such a case, correcting the output signal of the subject 

20 pixel using only the output signal of a pixel neighboring 
the subject pixel either in the horizontal or vertical 
direction may result in false colors. 



Moreover, it is preferred to perform the output 
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level correction separately for the respective primary 
colors to be displayed. For example, where the primary 
colors R, G and B are displayed, it is preferred to perform 
a more precise correction for the primary color G using 
5 the color distribution of the primary colors Bayer pattern 
because the primary color G is more important than the 
other primary colors R and B. 

For example, as illustrated in Figure 2, the pixel 
10 region maskl is prescribed surrounding the subject 
pixel Rl for the primary color R, while the pixel re- 
gion mask2 is prescribed surrounding the subject pixel Bl 
for the primary color B. Assuming that the corrected 
output level of the subject pixel Rl or Bl is y(i, j), the 
15 average of the output levels of the other eight pixels, 
which are in the same pixel region and which represent 
the same color as that of the subject pixel Rl or Bl, is 
determined based on Expression (13) below. 

20 y(i,j)= [y(i-2, j-2)+y(i, j-2)+y(i+2, j-2) 

+y(i-2, j )+y(i+2, j )+y(i-2, j+2) 
+y(i, j+2)+y(i+2, j+2) ]/8 ... (13) 



For the primary color G, the pixel region mask4 
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is prescribed surrounding the subject pixel Gl, also as 
illustrated in Figure 2. Assuming that the corrected 
output level of the subject pixel Gl is y(i, j ) , the average 
of the output levels of the other four pixels, which are 
5 in the same pixel region and which represent the same color 
as that of the subject pixel Gl, is determined based on 
Expression (14) below. 

y<i, j)= [y(i-i, j-D+y(i+i, j-D+y(i-i, j + D 

10 +y(i+l, j+1) ]/4 ... (14) 

In Expressions (13) and (14), designations such 
as " (i,j)" denote coordinate points. 

15 The relatively small pixel region mask4 is used 

to obtain an accurate amount of light incident upon the 
subject pixel Gl because the human eye is most sensitive 
to the primary color G of the three primary colors . 

20 A pixel defect detector according to one 

embodiment of the present invention is used for detecting 
a pixel defect in a solid-state imaging device (e.g., a 
CCD) such as a digital still camera. The digital still 
camera is provided with a special mode of operation for 
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the pixel defect detection. In the special mode, the 
detection of a defect in a solid-state imaging device is 
substantially automatically performed in response to a 
predetermined operation by a user. Thus, the position of 
5 a pixel having a defect and the output characteristics 
of the pixel are recorded . Then , in a normal shooting mode , 
output signals from each pixel having a defect are 
corrected based on the recorded data. 

10 For the pixel defect detection, a y correction is 

not performed on the output signal of the solid-state 
imaging device so that the amount of error occurring in 
the output signal from the pixel having a defect will not 
be reduced. 

15 

In the pixel defect detector according to this 
embodiment of the present invention, the output 
characteristics of the solid-state imaging device are 
determined by applying varied amounts of light to the 
20 solid-state imaging device. Various functions of the 
digital still camera such as the diaphragm, the strobe, 
and the shutter speed, may be used alone or in combination 
so as to vary the amounts of light incident upon the 
solid-state imaging device. 
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In the pixel defect detection mode, the digital 
still camera is preferably defocused so that a uniform 
level of light is incident across the solid-state imaging 
5 device. For example, even when a wall or a panel having 
a uniform gray level is imaged by the digital still camera 
so as to obtain a uniform level of light incident across 
the solid-state imaging device, there may be some 
non-uniformity in the gray level of the object and/or some 
10 non-uniformity in the illumination for the object. By 
defocusing the digital still camera, it is possible to 
blur such non-uniformity, thereby applying a more uniform 
level of light incident across the solid-state imaging 
device . 

15 

Figure 3 is a block diagram illustrating a digital 
still camera incorporating the pixel defect detector 
according to one embodiment of the present invention. 
Referring to Figure 3, light is incident upon a 
20 solid-state imaging device (e.g., a CCD) 4 via a lens 
section 1, a diaphragm 2 and a shutter 3, thereby 
projecting a picture onto an imaging screen of the 
solid-state imaging device 4. The solid-state imaging 
device 4 includes a plurality of photoelectric 
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transducers (pixels) arranged in rows and columns, and 
the picture is projected onto such an arrangement of pixels . 
The output signals from these pixels are successively sent 
to a picture processing section 6 via a switching module 5 . 
5 A strobe 7 emits light in synchronism with the open- 
ing/closing of the shutter 3 so as to irradiate the object. 
A group of operation keys 8 are used by a user to operate 
the digital still camera. 



10 The picture processing section 6 primarily com- 

prises a picture memory 11, an EEPROM 12, a data table 13, 
a control signal producing section 14, and a processor 15. 
The picture memory 11 stores the output levels of the 
pixels of the solid-state imaging device 4, i.e. , picture 

15 data representing the imaged picture. Typically, the 
picture memory 11 is capable of storing at least three 
pictures. The EEPROM 12 stores: photoelectric coeffi- 
cients a 0R , a 0G , a 0B , threshold values Aa R , Aa G , Aa B , and 
Ab R , Ab G , Ab B , which are predetermined for the respective 

20 primary colors R, G and B; the reference offset output 
level b 0 ; and the size of the imaging screen of the 
solid-state imaging device 4 (represented by the number 
of pixels along the horizontal direction 10 times that 
along the vertical direction JO on the imaging screen). 
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The data table 13 stores various data such as data used 
for performing a y correction on the picture data, and data 
used for performing a JPEG compression on the picture data. 
The control signal producing section 14 produces and 
5 outputs a control signal for controlling, in response to 
an instruction from the processor 15, the lens section 1, 
the diaphragm 2, the shutter 3, the solid-state imaging 
device 4, the switching module 5, the strobe 7, etc. The 
processor 15 controls the picture processing section 6, 
10 processes picture data and performs various other 
arithmetic operations . 

The picture processing section 6 may be produced 
on a single-chip LSI. 

15 

In the digital still camera of this embodiment of 
the present invention, the normal shooting mode can be 
selected by operating the group of operation keys 8. 

20 In the normal shooting mode, in response to an 

appropriate operation of the group of operation keys 8, 
the processor 15: drives the lens section 1 so as to focus 
the picture being projected onto the imaging screen of 
the solid-state imaging device 4 (auto-focus); adjusts 
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the stop of the diaphragm 2; opens/closes the shutter 3; 
and controls the strobe 7 to emit light in synchronism 
with the opening/closing of the shutter 3. As a result, 
the picture is imaged by the solid-state imaging device 4 . 
5 Then, the processor 15: receives the picture data from 
the solid-state imaging device 4 via the switching 
module 5; temporarily stores the picture data in the 
picture memory 11; performs image processes (e.g., ay 
correction and an image compression) on the picture data; 
10 and sends the processed picture data to a recording 
mechanism of a recording medium (not shown). The 
recording mechanism records the processed picture data 
on the recording medium. 



15 In the digital still camera of this embodiment of 

the present invention, the pixel defect detection mode 
can be selected by operating the group of operation keys 8 . 
When the pixel defect detection mode is selected, the 
processor 15 performs the procedure illustrated in the 

20 flow chart of Figure 4 so as to automatically detect a 
pixel having a defect and store the coordinate position 
of the pixel in the EEPROM 12. Thus, the detection of a 
defect pixel can be done by a user without requiring any 
special device or knowledge. 
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First, the processor 15 prepares an area in the 
picture memory 11 for storing three pictures, and 
inactivates functions such as the y correction, the image 
5 compression, and the auto-focus of the lens section 1 
(step 101). -The processor 15 further drives the lens 
section 1 so as to set the focus of the lens section 1 
to oo, for example (step 102). 

10 After setting the release time of the shutter 3 

to zero, the switching module 5 receives the output signal 
from each pixel of the solid-state imaging device 4 via 
the switching module 5, and stores the output levels of 
the pixels in a first picture data storage area of the 

15 picture memory 11 (step 103). 

When the release time of the shutter 3 is set to 
zero, the amount of light incident upon each pixel of the 
solid-state imaging device 4 is zero, whereby the output 
20 of each pixel is at the lowest level. 

Subsequently, the processor 15 sets the dia- 
phragm 2 to "open", and opens/closes the shutter 3, while 
controlling the strobe 7 to emit light in synchronism with 
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the opening/closing of the shutter 3. Then, the 
processor 15 receives the output signal from each pixel 
of the solid-state imaging device 4 via the switching 
module 5, and stores the output levels of the pixels in 
5 a second picture data storage area of the picture memory 11 
(step 104) . - 



In the above-described operation, the release 
time of the shutter 3 is set so that an amount of light 

10 is incident upon each pixel, which brings the solid-state 
imaging device 4 to a near-overflow state (i.e., the 
amount of incident light is maximized without bringing 
the solid-state imaging device 4 to the overflow state), 
thereby maximizing the output level of the pixel. As 

15 described above, it is preferable for detecting a pixel 
having a defect to use a wall or a panel having a uniform 
gray level, so that the picture imaged by the solid-state 
imaging device 4 has a substantially uniform gray scale. 
Moreover, since the focus of the lens section 1 is adjusted 

20 to oo, the picture imaged by the solid-state imaging 
device 4 is blurred to provide an even more uniform gray 
scale. Such a picture having a uniform gray scale is 
preferred in detecting a pixel having a particularly low 
output level (i.e. , a particularly dark pixel) or a pixel 
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having a particularly high output level (i.e., a 
particularly bright pixel ) , i.e., a pixel having a defect . 

Moreover, the processor 15 sufficiently stops 
down the diaphragm 2, and opens/closes the shutter 3, 
while controlling the strobe 7 to emit light in 
synchronism with the opening/closing of the shutter 3. 
Then, the processor 15 receives the output signal from 
each pixel of the solid-state imaging device 4 via the 
switching module 5, and stores the output levels of the 
pixels in a third picture data storage area of the picture 
memory 11 (step 105). 

Since the shutter 3 is opened/closed while 
sufficiently stopping down the diaphragm 2 with the 
strobe 7 emitting light, the amount of light incident upon 
each pixel of the solid-state imaging device 4, and thus 
the output level of each pixel, are between those of 
step 103 and those of step 104, respectively. The 
photographed object of the digital still camera is 
preferably the same in steps 104 and 105. In step 105, 
it is preferable to image a wall or a panel having a uniform 
gray level, as described above. Since the focus of the 
lens section 1 is adjusted to oo, the picture imaged by 
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the solid-state imaging device 4 is blurred to provide 
a uniform gray scale. 



In this way, the following three output levels are 
5 stored in the picture memory 11 in steps 103, 104 and 105, 
respectively^ the output level of each pixel of the 
solid-state imaging device 4 for the minimum amount of 
incident light; the output level of each pixel of the 
solid-state imaging device 4 for an intermediate amount 
10 of incident light; and the output level of each pixel of 
the solid-state imaging device 4 for the maximum amount 
of incident light . 

Thus, the input/output relationship as repre- 
15 sented by Expression (5) above (N-l=2) holds for each 
pixel of the solid-state imaging device 4. 



Then, the processor 15 successively addresses the 
pixels of the solid-state imaging device 4 by successively 
20 designating addresses, i.e., the coordinate positions 
(i,j). Each time a coordinate position (i,j) is desig- 
nated, it is determined which of the primary colors R, 
G and B is to be displayed by the pixel at the designated 
coordinate position (i, j) based on the coordinates i and 
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j of the position, while calculating the above-described 
function for the addressed pixel so as to determine the 
presence/absence and the type of defect of the pixel. 

5 In this embodiment of the present invention, a 

color filter of a primary colors Bayer pattern as 
illustrated in Figure 2 is used, whereby it is possible 
to determine which of the primary colors R, G and B is 
to be displayed by the pixel at the coordinate posi- 
10 tion (i,j) based on the coordinates i and j of the 
position . 

First, the processor 15 initializes the coordi- 
nate position ( i, j ) to ( 0 , 0 ) . Moreover, the processor 15 

15 reads out, from the EEPROM 12, various data such as: the 
photoelectric coefficients a 0R , a 0G , a 0B # threshold val- 
ues Aa R , Aa G , Aa B , andAb R , Ab G , Ab B , which are predetermined 
for the respective primary colors R, G and B; the reference 
offset output level b 0 ; and the size of the imaging screen 

20 of the solid-state imaging device 4 (represented by the 
number of pixels along the horizontal direction (10-1) 
times that along the vertical direction (J0-1) on the 
imaging screen) (step 106). 
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Then, the processor 15 determines whether each of 
the coordinates i and j of the coordinate position (i,j) 
is an even number (steps 107, 108). 

5 After the initialization, each of the initialized 

coordinates i=0 and j = 0 is determined to be an even number 
(i.e., "yes" is given at step 107 and at step 108). In 
the primary colors Bayer pattern as illustrated in 
Figure 2, any pixel at a coordinate position where the 
10 coordinates i and j are both an even number displays the 
primary color R. Therefore, the presence/absence and the 
type of defect of the pixel displaying the primary color R 
are determined (step 109). 

15 In step 109, the processor 15 assumes the pixel 

at the coordinate position (0,0) to be the subject pixel, 
and extracts the output levels of all the necessary pixels 
from the three pictures of data, which have been stored 
in the picture memory 11 in steps 103-105, respectively. 

20 The processor 15 further determines the amount of light 
incident upon the subject pixel based on Expression (8) 
and Expression (2) above, determines the photoelectric 
coefficient a and the offset output level b of the subject 
pixel based on Expression (7) above, and determines the 
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presence/absence and the type of defect of the subject 
pixel based on Expression ( 9 ) above . If the subject pixel 
has a defect, the type of defect (i.e., a white blemish 
or a black blemish) and the coordinate position of the 
5 subject pixel are stored in the picture memory 11. 

Thereafter, the processor 15 determines whether 
the next coordinate position (i+1, j) to the right falls 
beyond the horizontal size (10-1) of the imaging screen 
10 (step 110). If "No" is given at step 110, the proces- 
sor 15 then adds 1 to i so as to update the coordinate 
position (i,j) (step 111). Then, the process returns to 
step 107. 

15 The coordinate i of the updated coordinate 

position (i,j) is now 1, an odd number. Thus, i is 
determined to be an odd number ( "No" is given at step 107 ) , 
while j is still determined to be an even number ("Yes" 
is given at step 115). In the primary colors Bayer 

20 pattern as illustrated in Figure 2, any pixel at such a 
coordinate position displays the primary color G. 
Therefore, the presence/absence and the type of defect 
of the pixel displaying the primary color G are determined 
( step 112 ) . 
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In step 112, the processor 15 assumes the pixel 
at the coordinate position (1,0) to be the subject pixel, 
and extracts the output levels of all the necessary pixels 
5 from the three pictures of data, which have been stored 
in the picture memory 11 in steps 103-105, respectively. 
The processor 15 further determines the amount of light 
incident upon the subject pixel based on Expression (8) 
and Expression (2) above, determines the photoelectric 

10 coefficient a and the offset output level b of the subject 
pixel based on Expression (7) above, and determines the 
presence/absence and the type of defect of the subject 
pixel based on Expression (10) above. If the subject 
pixel has a defect, the type of defect (i.e., a white 

15 blemish or a black blemish) and the coordinate position 
of the subject pixel are stored in the picture memory 11. 




In the primary colors Bayer pattern as illustrated 
in Figure 2, the pixels at coordinate positions (i,0) 
20 alternately correspond to the primary colors R and G. 

Therefore, subsequently for other pixels at coordinate 
positions (i,0), step 109 and step 112 are alternately 
performed as described above so as to determine the 
presence/absence and the type of defect of the subject 
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pixel at each coordinate position ( i , 0 ) while storing such 
data for any subject pixel having a def ect . 



When i+1 is equal to 10 ( "Yes " is given at step 110 ) , 
5 the processor 15 then determines whether the next 
coordinate position (i,j+l) below the position (i,j) 
falls beyond the vertical size ( JO - 1 ) of the imaging screen 
(step 113). If "No" is given at step 113, the proces- 
sor 15 then adds 1 to j so as to update the coordinate 
10 j to 1 ( step 114 ) . Since the coordinate j is an odd number 
("No" is given at step 108 and at step 115), either 
step 112 or step 116 is performed depending upon the 
determination of whether the coordinate i is an even number 
(step 107) . 

15 

In step 112, the presence/absence and the type of 
defect of the pixel displaying the primary color G are 
determined as described above. In step 116, the pres- 
ence/absence and the type of defect of the pixel displaying 
20 the primary color B are determined. For the determina- 
tion, the processor 15 extracts the output levels of all 
the necessary pixels from the three pictures of data, which 
have been stored in the picture memory 11 in steps 103-105 , 
respectively. The processor 15 further determines the 
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amount of light incident upon the subject pixel based on 
Expression (8) and Expression (2) above, determines the 
photoelectric coefficient a and the offset output level b 
of the subject pixel based on Expression (7) above, and 
5 determines the presence/absence and the type of defect 
of the subject pixel based on Expression (11) above. If 
the subject pixel has a defect, the type of defect (i.e., 
a white blemish or a black blemish) and the coordinate 
position of the subject pixel are stored in the picture 
10 memory 11. 



In the primary colors Bayer pattern as illustrated 
in Figure 2, the pixels at coordinate positions (i,l) 
alternately correspond to the primary colors B and G. 

15 Therefore, subsequently for other pixels at coordinate 
positions (i,l), step 116 and step 112 are alternately 
performed as described above so as to determine the 
presence/absence and the type of defect of the subject 
pixel at each coordinate position ( i , 1 ) while storing such 

20 data for any subject pixel having a defect. 

Subsequently, as the coordinate j is incremented, 
^nate i is successively varied from 0 to (10-1) 
so as to determine the presence/absence and the type of 
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10 



15 



defect for each uixel at a coordinate position (0- 
( 10-1 ) , j ) . The determination of the presence/absence and 
the type of defect! for all the pixels is complete when 
i+1 is determined to be equal to (10-1) ("Yes" is given 
at step 110) while j + l is determined to be equal to ( J0-1) 
("Yes" is given at step 113). Then, the processor 15 
reads out the type of defect of each pixel having a defect 
and the coordinate position thereof from the picture 
memory 11, and stores the data in the EEPROM 12. 

When the above-described shooting mode is se- 
lected after the type of defect of each pixel of the 
solid-state imaging device 4 having a defect and the 
coordinate position thereof have been stored in the 
EEPROM 12, the following process is performed to correct 
the output level of each defect pixel. 



As the normal shooting mode is selected by the 
operation of the group of operation keys 8, a picture is 
20 imaged by the solid-state imaging device 4, and the 
processor 15 receives picture data from the solid-state 
imaging device 4 via the switching module 5. 



The switching module 5 has a structure as 
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illustrated in Figure 5, and comprises three termi- 
nals SW1, SW2 and SW3 . When a segment 5a is switched to 
the terminal SW1, the output of the solid-state imaging 
device 4 is directly transmitted to the processor 15, 
5 thereby storing the output level of each pixel in the 
picture memory 11. 



The processor 15 reads out the coordinate posi- 
tion (i, j) of a pixel having a defect from the EEPROM 12, 

10 so as to identify the color displayed by the pixel having 
a defect based on the coordinates i and j , and switches 
the switching module 5 to the terminal SW2 or SW3 at a 
timing at which a signal is output from the pixel. In 
particular, the processor 15 determines the color dis- 

15 played by the pixel having a defect based on the 
coordinates i and j in a manner similar to that of 
steps 107, 108 and 115. Then, if the color displayed by 
the pixel is determined to be R or B, the processor 15 
switches the switching module 5 to the terminal SW2 at 

20 a timing at which a signal is output from the pixel. If 
the color displayed by the pixel is determined to be G, 
the processor 15 switches the switching module 5 to the 
terminal SW3 at a timing at which a signal is output from 
the pixel. 
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When the processor 15 receives the output signal 
of a defect pixel of the primary color R or B through the 
terminal SW2 of the switching module 5, the processor 15 
5 performs the calculation of Expression (13) above so as 
to determine^the output level of the defect pixel (after 
data necessary for performing the calculation of 
Expression (13) above has been transmitted from the 
solid-state imaging device 4 to the picture memory 11), 
10 and stores the determined output level in an address in 
the picture memory 11 for the defect pixel. 

When the processor 15 receives the output signal 
of a defect pixel of the primary color G through the 

15 terminal SW3 of the switching module 5, the processor 15 
performs the calculation of Expression (14) above so as 
to determine the output level of the defect pixel (after 
data necessary for performing the calculation of 
Expression (14) above has been transmitted from the 

20 solid-state imaging device 4 to the picture memory 11), 
and stores the determined output level in an address in 
the picture memory 11 for the defect pixel. 



Thus, by switching the segment 5a of the switching 
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module 5 to the terminal SW1, SW2 or SW3 , it is possible 
to correct the output level of the defect pixel in a 
substantially real-time manner while storing the picture 
data from the solid-state imaging device 4 in the picture 
5 memory 11. 

Thereafter, image processes (e.g. , ay correction 
and an image compression) are performed on the picture 
data stored in the picture memory 11, and the processed 
10 picture data is sent to a recording mechanism of a 
recording medium (not shown) so as to record the processed 
picture data on the recording medium. 



Instead of determining the color displayed by the 
15 pixel having a defect based on the coordinates i and j 
in a manner similar to that of steps 107, 108 and 115 as 
illustrated in Figure 4, it is possible to perform the 
determination while utilizing the fact that i or j is an 
even number when the least significant bit thereof is "0" , 
20 and is an odd number when it is "1". Thus, the color 
displayed by the pixel is determined to be R or B if the 
XOR between i and j is false, and G if it is true. 

While the above-described pixel defect detection 
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mode is selected, the segment 5a is always connected to 
the terminal SW1. 



As is apparent from the description above, with 
5 the digital still camera of this embodiment of the present 
invention, it is possible to automatically detect the 
coordinate position of a pixel having a defect and the 
type of defect and correct the output signal of the defect 
pixel, only by obtaining three pictures of data through 
10 multiple picture shooting operations, without requiring 
a reference light generator, a special aided system, or 
the like. Therefore, even a user can easily perform the 
detection and correction of defect pixels, 

15 The present invention is not limited to the 

above-described particular embodiment. Various modifi- 
cations can be made to the above -described embodiment. 
For example, while the photoelectric coefficient a and 
the offset output level b of each pixel are determined 

20 based on three output levels therefrom in response to three 
different amounts of incident light, respectively, in the 
above-described embodiment, the photoelectric coeffi- 
cient a and the offset output level b may alternatively 
be determined based on two or four output levels for two 
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or four different amounts of incident light, 



When the photoelectric coefficient a and the 
offset output level b are determined based on two output 
5 levels for two different amounts of incident light. 
Expressions -(5), (6) and (7) above may be unnecessary. 
Instead, the photoelectric coefficient a and the offset 
output level b may be obtained by determining two 
different amounts of incident light based on Expres- 
10 sions (8) and (2) and detecting two output levels from 
a pixel in response to the two amounts of incident light. 



In the above-described embodiment, an output of 
a pixel is approximated by a linear function so that the 

15 scale of the arithmetic circuit, the amount of calculation 
and the time required for calculation are within the 
practical range. Strictly speaking, the output charac- 
teristic of a photoelectric transducer is non-linear. 
When it is difficult to approximate the output 

20 characteristic of the photoelectric transducer with a 
single linear function, a combination of a plurality of 
linear functions or another type of function may be used 
provided that the possible increase in the scale of the 
arithmetic circuit, the amount of calculation and the time 
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required for calculation is minimized. With any type of 
function being used, the presence/absence and the type 
of defect of a pixel can be determined by representing 
the actual output characteristic of the pixel in the 
5 function and comparing the coefficients of the function 
with one another. 



The output level of a normal pixel may alterna- 
tively be determined by any appropriate means other than 

10 the use of the median filter of Expression (8) above. For 
example, the output level of a normal pixel may be 
determined by using the median filter after excluding the 
maximum and minimum output levels among those of the pixels 
neighboring the subject pixel within the same pixel region, 

15 or alternatively by performing a well-known statistical 
operation on the output levels of the pixels neighboring 
the subject pixel within the same pixel region . Moreover, 
various pixel regions may be prescribed surrounding the 
subject pixel, other than those described above. 

20 

While a CCD is described as an exemplary 
solid-state imaging device in the above-described 
embodiment, the present invention is not limited thereto. 
For example, the present invention may alternatively be 
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used for other types of solid-state imaging device such 
as CID or CPD. Moreover, the present invention may 
alternatively be used for solid-state imaging apparatuses 
other than a digital still camera, such as a video camera, 
5 or a film scanner. 

While a color filter of a primary colors Bayer 
pattern is described in the above-described embodiment, 
the present invention may alternatively be used with other 
10 types of color filter in which primary colors and 
complementary colors are arranged according to a given 
rule . 

As described above, according to the present 
15 invention, output characteristics of a subject 
photoelectric transducer in response to varied amounts 
of light incident upon the subject photoelectric 
transducer are determined, so as to detect a defect in 
the subject photoelectric transducer based on the output 
20 characteristics. 

Alternatively, according to the present invention, 
outputs of a subject photoelectric transducer in response 
to different amounts of incident light may be stored in 
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the picture memory so as to determine the photoelectric 
coefficient a of the subject photoelectric transducer and 
the offset output level b of the subject photoelectric 
transducer in the absence of incident light, based on the 
5 amounts of incident light, the outputs of the subject 
photoelectric transducer therefor, and Expression (1). 
A defect in the subject photoelectric transducer is 
detected by comparing the photoelectric coefficient a and 
the offset output level b with a predetermined reference 
10 photoelectric coefficient a 0 and a predetermined refer- 
ence offset output level b 0 , respectively. 



y(x) =ax+b ... ( 1 ) 

15 Herein, y(x) denotes the output of the subject 

photoelectric transducer, and x denotes the amount of 
incident light . 



As described above, the output characteristic of 
20 the subject photoelectric transducer is determined, so 
as to detect a defect of the subject photoelectric 
transducer based on the output characteristic. In this 
way, a reference light generator, a special aided system, 
or the like, as in the prior art, is not required, whereby 
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even an ordinary user can easily detect a defect of a 
photoelectric transducer. Not only the presence/absence 
of the defect, but also the type of defect, can be 
determined. 

5 

Moreover, according to the present invention, the 
output of a photoelectric transducer is determined while 
the solid-state imaging device is defocused. Therefore, 
a substantially uniform light is incident upon a pixel 

10 region surrounding the subject photoelectric transducer. 

Therefore, it is possible to identify the output signal 
of a normal photoelectric transducer based on output 
signals from a plurality of photoelectric transducers in 
the same pixel region, thereby estimating the actual 

15 amount of incident light. 

Furthermore, an amount of incident light which is 
measured when no light is incident upon the solid-state 
imaging device, and another amount of incident light which 
20 brings the solid-state imaging device to a near-overflow 
state. These amounts of incident light can easily be 
obtained by appropriately controlling the shutter speed, 
the diaphragm, the strobe, and the like, of a video camera 
or a digital still camera. 



99R00174 



- 51 



For a color display, photoelectric transducers 
for different colors are separately examined. Therefore, 
it is possible to accurately determine the pres- 
5 ence/absence and the type of defect of the photoelectric 
transducer. - 

Moreover, for a color display , the color displayed 
by each pixel is determined based on address data (i.e., 
10 the coordinate position) of the pixel, thereby allowing 
the calculation to be performed faster. 

Various other modifications will be apparent to 
and can be readily made by those skilled in the art without 
15 departing from the scope and spirit of this invention. 

Accordingly, it is not intended that the scope of the 
claims appended hereto be limited to the description as 
set forth herein, but rather that the claims be broadly 
construed. 



